On the Information Loss in Memoryless Systems: The Multivariate Case
نویسندگان
چکیده
In this work we give a concise definition of information loss from a system-theoretic point of view. Based on this definition, we analyze the information loss in memoryless inputoutput systems subject to a continuous-valued input. For a certain class of multiple-input, multiple-output systems the information loss is quantified. An interpretation of this loss is accompanied by upper bounds which are simple to evaluate. Finally, a class of systems is identified for which the information loss is necessarily infinite. Quantizers and limiters are shown to belong to this class.
منابع مشابه
Minimizing Loss of Information at Competitive PLIP Algorithms for Image Segmentation with Noisy Back Ground
In this paper, two training systems for selecting PLIP parameters have been demonstrated. The first compares the MSE of a high precision result to that of a lower precision approximation in order to minimize loss of information. The second uses EMEE scores to maximize visual appeal and further reduce information loss. It was shown that, in the general case of basic addition, subtraction, or mul...
متن کاملLandslide Hazard Zoning Using Multivariate Linear Regression (Case Study: Kohsar Watershed)
The aim of this research was to generate a landslide hazard zoning map by using the multivariate linear regression method in the Kohsar Watershed, Northwest of Tehran. Initially, we used field surveys, local interview and review of studies outside and inside of Iran. Eleven effective factors were recognized on landslide. These factors included: slope degree, slope aspect, elevation, lithology, ...
متن کاملIntroduction of a Framework for Customer Orientation Using Ambulant E-Banking Services Marketing (Case Study: Mellat Bank in Isfahan)
E-banking (electronic banking) is the modified business banking toward E-business (electronic business) banking that actually uses the electronic communication channels such as internet, phones, cell phones and the like. By using this method, the demands of customers such as time independent and high flexible actions are satisfied. In this process, marketing is so important because guiding cust...
متن کاملIntroduction of a Framework for Customer Orientation Using Ambulant E-Banking Services Marketing (Case Study: Mellat Bank in Isfahan)
E-banking (electronic banking) is the modified business banking toward E-business (electronic business) banking that actually uses the electronic communication channels such as internet, phones, cell phones and the like. By using this method, the demands of customers such as time independent and high flexible actions are satisfied. In this process, marketing is so important because guiding cust...
متن کاملOn the Rate of Information Loss in Memoryless Systems
In this work we present results about the rate of (relative) information loss induced by passing a real-valued, stationary stochastic process through a memoryless system. We show that for a special class of systems the information loss rate is closely related to the difference of differential entropy rates of the input and output processes. It is further shown that the rate of (relative) inform...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
- CoRR
دوره abs/1109.4856 شماره
صفحات -
تاریخ انتشار 2011